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METHODS AND SYSTEMS FOR ANALYZING 
fflSTORICAL TRENDS IN MARKETING 
CAMPAIGNS 

BACKGROUND OF THE INVENTION 

This invention relates generally to marketing and, more particularly, to 
methods and systems for identifying and marketing to segments of potential 
customers. 

Typical marketing strategies involve selecting a particular group based 
on demographics or other characteristics, and directing the marketing effort to that 
group. Known methods typically do not provide for proactive and effective consumer 
relationship management or segmentation of the consumer group to increase 
efficiency and returns on the marketing campaign. For example, when a mass mailing 
campaign is used, the information used to set up the campaign is not segmented 
demographically to improve the efficiency of the mailing. The reasons for these 
inefficiencies include the fact that measurement and feedback is a slow manual 
process that is limited in the depth of analysis. Another reason is that data collected 
from different consumer contact points are not integrated and thus does not allow a 
marketing organization a full consumer view. 

Results of this inefficient marketing process include loss of market 
share, increased attrition rate among profitable customers, and slow growth and 
reduction in profits. 

BRIEF SUMMARY OF THE INVENTION 

Models are used in methods and systems for evaluating marketing 
campaign data. Models are mathematical algorithms that map customer and/or 
account attributes to scores that indicate, for example, a customer's propensity to 
attrite, default on payments, and expected profitability. Models are used to target 
segments for marketing. On Line Analytical Processing (OLAP) structures based on 
campaign drivers, which are attributes used in the models, and can be built for several 
campaigns to yield time based history structures. The method includes the steps of 
evaluating models and discovering user defined trends in the time based history 
structures. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram of an exemplary embodiment of a web- 
based global modeling architecture; 

Figure 2 is a block diagram of an exemplary embodiment of a targeting 

engine; 

5 Figure 3 is an exemplary graphical user interface for pre-selecting 

mailing criteria; 

Figure 4 is an exemplary user interface for the input of marketing 

criteria; 

Figure 5 is an exemplary user interface for selection of structures; 
io Figure 6 is an exemplary user interface for selection of campaigns; 

Figure 7 is an exemplary user interface for creation of a selection table; 

and 

Figure 8 is an exemplary viser interface for a gains chart. 
DETAILED DESCRIPTION OF THE INVENTION 

is Exemplary embodiments of processes and systems for integrating 

targeting information to facilitate identifying potential sale candidates for marketing 
campaigns are described below in detail. In one embodiment, the system is internet 
based. The exemplary processes and systems combine advanced analytics. On Line 
Analytical Processing (OLAP) and relational data base systems into an infrastructure. 

20 This incfrastructure gives users access to information and automated information 
discovery in order to streamline the plaiming and execution of marketing programs, 
and enable advanced customer analysis and segmentation of capabilities. 

The processes and systems are not limited to the specific embodiments 
described herein. In addition, components of each process and each system can be 
25 practiced independent and separate from other components and processes described 
herein. Each component and process can be used m combination with other 
components and processes. 
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Figure 1 is a block diagram of an exemplary embodiment of a web- 
based global modeling architecture 10. Data from various international markets 12 is 
compiled in a consumer database 14. Consumer database 14 contains user defined 
information such as age, gender, marital status, income, transaction history, and 
transaction measures. Customer database 14 is accessible by a server 16. Server 16 
stores the consimier database 14 in a relational database such that the consumer data is 
accessible to a targeting engine (not shown in Figure 1) which takes data input and 
based upon modeling generates user interfaces 18. Architecture 10 may also be 
client/server based. 

Figure 2 illustrates a marketing system 20. Included in marketing 
system 20 are a targeting engine 22 and a plurality of data inputs and outputs. Data 
inputs include a customer database 24, selection criteria 26, previous campaign results 
28 and marketing data 30. Targeting engine 22 generates targeting mailing lists 32, 
campaign and data structures 34 and gains charts 36. Historical campaign and data 
structures 34 are reusable by targeting engine 22. Targeting engine 22 also generates 
outputs to a user interface 38, typically in a graphic format. Targeting engine 22 
streamlines the planning and execution of marketing programs and enables advanced 
customer analysis and segmentation capabilities. Targeting engine 22 further delivers 
information in a proactive and timely manner to enable a user to gain a competitive 
edge. Targeting engine 22 accompUshes these goals through the use of models. 

MODELS 

Models are predicted customer profiles based upon historic data. Any 
number of models can be combined as an OLAP cube which takes on the form of a 
multi dimensional structure to allow immediate views of dimensions including for 
example, risk, attrition, and profitability. 

Models are embedded within targeting engine 22 as scores associated 
with each customer, the scores can be combined to arrive at relevant customer metrics. 
In one embodiment, models used are grouped under two general categories, namely 
marketing and risk. Examples of marketing models include: a net present value / 
profitability model, a prospect pool model, a net conversion model, an early 
termination (attrition) model, a response model, a revolver model, a balance transfer 
model, and a reactivation model. A propensity model is used to supply predicted 
answers to questions such as, how likely is this customer to: close out an account 
early, default, or avail themselves to another product (cross-sell). As another 

-3- 



17207-00006 



example, profitability models guide a user to optimized marketing campaign 
selections based on criteria selected fi-om the consumer database 24. A payment 
behavior prediction model is included that estimates risk. Other examples of risk 
models are a delinquency and bad debt model, a firaud detection model, a bankruptcy 
model, and a hit and run model. In addition, for business development, a client 
prospecting model is used. Use of models to leverage consumer information ensures 
right value propositions are offered to the right consumer at the right time by tailoring 
messages to unique priorities of each customer. 

TARGETING ENGINE 

Targeting engine 22 combines the embedded models described above 
to apply a score to each customer's account and create a marketing program to best 
use such marketmg resources as mailing, telemarketing, and internet online by 
allocating resources based on consumer's real value. Targeting engine 22 maintains a 
multi-dimensional customer database based in part on customer demographics. 
Examples of such customer related demographics are: age, gender, income, 
profession, marital status, or how long at a specific address. When applied in certain 
coimtries, that fact that a person is a foreign worker could be relevant. The examples 
listed above are illustrative only and not intended to be exhaustive. Once a person has 
been a customer, other historical demographics can be added to the database, by the 
sales force, for use in future targeting. For example, what loan products a customer 
has previously purchased is important when it comes to marketing that person a 
product in the future in determining a likelihood of a customer response. To illustrate, 
if a person has purchased an automobile loan within the last six montiis, it probably is 
xmreasonable to expend marketing effort to him or her in an automobile financing 
campaign. 

However a cash loan or home equity loan may still be of interest to the 
automobile loan purchaser. In deciding whether to market to him or her, other criteria 
that has been entered into the targeting engine 22 database in the form of a transaction 
database can be examined. The transaction database contains database elements for 
tracking performance of previously purchased products, in this case the automobile 
loan. Information tracked contains, for example, how often payments have been 
made, how much was paid, in total and at each payment, any arrears, and the 
percentage of the loan paid. Again the list is illustrative only. Using information of 
this type, targeting engine 22 can generate a profitability analysis by combining 
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models to determine a probability score for response, attrition and risk. Customers are 
rank ordered by probability of cross-sell response, attrition, risk, and net present 
value.. For example, if a consimier pays a loan off within a short time, that loan 
product was not very profitable. The same can be said of a product that is constantly 
in arrears. The effort expended in collection efforts tends to reduce profitability. 

When a marketer embarks on a campaign, they will input into targeting 
engine the desired size of the campaign. Using 60,000 as an example, the marketer 
inputs the target consumer selection criteria 26, some subset of the demographics 
listed above, into targeting engine 22. 

Targeting engine uses the stored databases and generates a potential 
customer list based on scores based on demographics and the propensity to buy 
another loan product and expected profitability. Customers can be targeted by the 
particular sales office, dealers, product type, and demographic profile. Targeting 
engine enables a user to manipulate and derive scores fi-om the information stored 
within the consumer and structure databases. These scores are used to rank order 
candidate accoimts for marketing campaigns based upon model scores embedded 
within the consumer and structure databases and are used in a campaign selection. 
Scores are generated with a weight accorded the factors, those factors being the 
demographics and the models used. Using the scores and profitability targeting 
engine generates a list of potential profitable accoimts, per customer and / or per 
product, in a rank ordering from a maximum profit to a zero profit versus cost. 

As candidate accounts are ranked by a selected model score, targeting 
engine 22 (shown in Figure 2) performs calculations at which marginal returns 
become zero, and the user is alerted to an optimal mailing depth which can override 
initial manually selected campaign size to form a marketing campaign customer list. 
The selected marketing campaign results in a database table which has the customer 
identification nxmiber, relevant model scores, flags that indicate whether the customer 
is a targeted or a random selection, and an indicator for the product offered. As 
shown in Figure 7, a user can use a user interface 80 to choose a particular database 
table. As an example, targeting engine 22 may determine that a mailing of 40,000 
units, as opposed to the requested 60,000 imits, is the maximum profitable for the 
example campaign. Conversely, targeting engine 22 may also determine that, for the 
requested campaign, 100,000 units have profit potential and will flag that information 
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to the marketer. To arrive at expected profitability numbers, targeting engine 22, has 
the capability to deduct costs, such as mailing cost, fi-om a proposed campaign. 

GRAPHICAL USER INTERFACE 

Users input the target consumer selection criteria 26 into targeting 
engine 22 through a simple graphical user interface 38. An exemplary example of a 
graphical user interface is shown in Figure 3. In this exemplary example, one of the 
options available to a user is to input pre-selection criteria for a mailing campaign 40. 
Once the user selects the mailing pre-selection criteria 40 option, another user 
interface 50, one possible example is Figure 4, allows the user to input the marketing 
criteria. Example marketing criteria shown are age 52, credit line 54, a profession 
code 56, and a plurality of risk factors 58. 

Once a user has input the marketing campaign pre-selection criteria 
into targeting engine, that criteria is retained by a targeting engine database. Details 
of all available criteria are retained as entries in a database table and duplication of 
previous efforts is avoided. 

Marketing campaigns can be stored within targeting engine 22. An 
exemplary example showing a graphical interface 60 used to choose previous 
marketing campaigns is shown in Figure 5. In this example, a user can choose 
between Campaign! 62 and Campaign2 64. Figure 6 is a user interface 70 showing 
structures associated with Campaign2 64. Structurel 72 indicates that analysis of the 
campaign based on age, gender, credit line and the targeting model is available. Users 
can build new structures on an ad-hoc basis by choosing the Create New Structure 74 
on user interface 70. By stacking structures of different campaigns in chronological 
order trends within segments can be discemed. As a result of the storage of marketing 
campaign structures within targeting engine database, those structures having time as 
one of the database elements allow a user to define trends whereby a marketing 
campaign history structure which is automatically analyzed by targeting engine 22. 

TREND ANALYSIS 

A trend analysis is a way to look at multiple marketing campaigns over 
time and is also a way to evaluate the models used and define trends. As an example 
of trend analysis, the user can determine where a response rate has been changing or 
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where profitability has been changing or look at the niraiber of accoxints bemg closed. 
A user can also analyze particular population segments over time. 

Trend analysis can be used to track how a particular segment, males 
from age 25 -35 with an auto loan for example, may change in a propensity to avail 
5 themselves to other loan products over time. 

CAMPAIGN ANALYSIS 

A user can create marketing test cells in the targeted accounts. Test 
cells are created using a range of selection criteria and random assignments. Accounts 
satisfying selection criteria are coimted. A marketing cell code for each account is 

1 0 assigned in the campaign table. The user can then ou^ut the contents of the campaign 
table to a file that can be exported to print a campaign mailmg. 

J A user can profile selected accounts and assign a score for any 

= campaign against a list of user defined dimensions. Assigning a score allows results 
= to be rank ordered. Profiling shows how targeted accounts differ fi-om non-selected 
15 accounts and is used to ensure the campaign is reaching the target base of the 

1 1 campaign. Profiling dimensions are selected during the initial customization process. 
Profiling can be done directly on a portfolio without any reference to marketing 
campaigns. 

^ Targeting engine 22 also accepts marketing campaign results based 

2I) upon each customer. Additional information can be appended onto the marketing 
campaign result files that become part of the consumer database. Exemplary 
examples of information that is added to the marketmg campaign result files are: loan 
size, loan terms, and risk score. Campaign analysis is done by comparing the original 
marketing campaign customer list against marketing campaign results. Targeting 
25 engine 22 then profiles this comparison information to construct gains charts. 

Maintaining feedback into targeting engine 22 improves subsequent 
modeling cycles. In the 60,000 example campaign explained previously, assume the 
size of the actual campaign after targeting engine applied a model was 40,000 
mailings. Information regarding who responded and how much was lent, for example, 
30 is input into targeting engine. Analysis facilitates a determination of how good the 
model performed when it told tbe marketer 40,000 mailings was the optimal campaign 
size. Analysis is accomplished in one embodiment by the use of gains charts. As an 
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example, the gains charts for the 40,000 mailings campaign may indicate that a 
mailing to 10% of the group may actually obtain 20% of all potential responders. 

An exemplary gains chart is displayed on the user interface 90 shown 
in Figure 8. As shown in Figure 8, when models are used to generate prospective 
5 customers for a marketing campaign, a larger nimiber of responses per campmgn size 
is generated, thereby increasing the efficiency of the marketing campaign and 
identifying risks such as delinquency and fraud. A gains chart approach allows a user 
to track performance of models used over several marketing campaigns and therefore 
allows a user to show where the model works best and where the performance of the 
10 model need to be addressed. 

Scores for customer accounts are generated as a part of a campaign 
analysis. Models are used to assign a score to an account as a result of a completed 
campaign. 

While the invention has been described in terms of various specific 
\ 5 embodiments, those skilled in the art will recognize that the invention can be practiced 
with modification within the spirit and scope of the claims. For example, although the 
above embodiments have been described in terms of a mailing campaign, the methods 
and systems described above are applicable to internet E-mail based campaigns and 
telemarketing campaigns. 
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WHAT IS CLAIMED IS: 

1 . A method of evaluating marketing campaign data, the data being in 
the form of database scores, stored procedures, and OLAP multidimensional 
structures, said method comprising the steps of: 

evaluating models using structures that can segment gains charts to 
discover where a model is under performing; and 

evaluating models performance over time and discovering user defined 

trends. 

2. A method according to Claim 1 wherein said step of discovering 
user defined trends fiirther comprises the step of determining where profitability has 
been changing over time. 

3. A method according to Claim 1 wherem said step of discovering 
user defmed trends fiirther comprises the step of determining where a response rate 
has been changing over time. 

4. A method according to Claim 1 wherein said step of discovering 
user defined trends further comprises the step of determining where a number of 
accounts are being closed. 

5. A method according to Claim 1 wherein said step of evaluating 
models is accomplished by creating history structures based on user defined attributes. 

6. A method according to Claim 1 wherein said step of discovering 
user defined trends fiirther comprises the step of analyzing a particular population 
segment. 

7. A method according to Claim 1 wherein said step of evaluating 
models performance over time and discovering user defined trends fiirther comprises 
the step of maintaining feedback into a targeting engine to improve subsequent 
modeling cycles. 

8. A method according to Claim 1 wherein said step of discovering 
user defined trends fiirther comprises the step of using gains charts to illustrate model 
performance in segments. 
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9. A system configured to evaluate marketing campaign data, said 
system comprising: 

a customer database further comprising historical campaign results; 
a graphical user interface for presentation of trend analysis data; and 
and optimal targeting using models. 

10. A system according to Claim 9 further configured to evaluate 
models that are time based multidimensional On Line Analytical Processing (OLAP) 
history structures. 

11. A system according to Claim 9 further configured to discover user 

defined trends. 

12. A system according to Claim 9 further configured to determine 
where profitability has been changing over time. 

13. A system according to Claim 9 further configured to determine 
where a response rate has been changing over time. 

14. A system according to Claim 9 further configured to determine 
where a number of accounts are being closed. 

15. A system according to Claim 9 further configured to determine 
propensity of a customer to avail themselves to other products over time. 

16. A system according to Claim 9 fiirther configured to check model 
performance of the model based on user defined criteria. 

17. A system according to Claim 9 fiirttier configured to analyze a 
particular population segment. 

18. A system according to Claim 9 fiirther configured to maintain 
feedback into a targeting engine to improve subsequent modeling cycles. 

19. A system according to Claim 9 further configured to use gains 
charts to illustrate customer trends. 
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METHODS AND SYSTEMS FOR ANALYZING 
fflSTORICAL TRENDS IN MARKETING 
CAMPAIGNS 

ABSTRACT OF THE DISCLOSURE 

Method and systems using models for evaluating marketing campaign 
data in the form of database scores, stored procedures, and OLAP multidimensional 
structures. Models are used to target segments for marketing. The models are 
mathematical algorithms that map customer and/or account attributes such as, a 
customer's propensity to attrite, default on payments, and expected profitability. The 
method includes the steps of evaluating models using OLAP structures based on 
campaign drivers, that can segment gains charts to discover where a model is under 
performing and evaluating models performance over time to discover user defined 
trends. 
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